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DESIGN OF SAFETY CRITICAL SYSTEMS 

Field of the Invention 
The present invention relates to system design and in particular to a 
5 method and technical aids for the design and verification of safety critical 
systems. 

Background to the Invention 
Many fault tolerant systems, up to now, have been built upon so called 
10 fault-tolerant frameworks on which general properties are proved and then 
installed. Such frameworks may be the basis for nuclear plants, trains or 
airplane control. 

Such frameworks are not scalable or flexible and are very expensive 
because they rely on a high level of hardware redundancy and have hardware 
15 prerequisites, for instance a dedicated bus driver or other components, (in 
particular verified micro-controllers with preexisting pieces of software). They 
are not adapted for large series production where cost optimization is a major 
issue. 

Attempts are being made to realize virtual prototyping, one example of 
20 which [SCHEID02] is embodied in the approach referred to as "Systems 
Engineering for Time Triggered Architectures" (SETTA). This can be found via 
the URL: "http://www.setta.org", one of whose publications is by Ch. Scheidler 
et ah "Systems Engineering for Time triggered Architectures, Deliverable D7.3, 
Final Document, version 1.0", XP-002264808, 18 April 2002. 
25 The time-triggered protocol (TTP) framework [Kop96] is a good example 

of a safety framework built for embedded electronics applications. It answers to 
a certain extent the flexibility and scalability mentioned above, but only at the 
level of communication between nodes. 

In all the examples above there is a common point,: in that a general 
30 safety critical framework is set and the design of an application must be made 
within the framework and under the specific rules of the framework. The safety 
proofs are achieved for the whole framework and not for a particular instance of 
the framework. For instance, in the TTP framework, at least four nodes are 
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required for "normal" 1 behavior of the system, and mapping four instances of a 
process on the different TTP nodes will guarantee that the results of these 
processes will be available in time and correct for the consumers of these 
processes. The idea is that a general proof exists for the physical architecture 
5 and that this proof specializes for the many instances of safety dataflow and 
functions embedded in the system. 

To give another idea, there is a citation in [Rush95] describing a project 
in which a safety critical framework, SIFT, has been designed: 

"In the SIFT project, several independent computing channels, each 
10 having their own processors operate in approximate synchrony; single source 
data such as sensors are distributed to each channel in a manner that is 
resistant to Byzantine (i.e. asynchronous) faults, so that a good channel gets 
exactly the same input data; all channels run the same application tasks on the 
same data at approximately the same time and the results are submitted to 
15 exact-match majority voting before being sent to the actuators". 

This is a good illustration of a safety critical framework. Note however 
that, in the paragraph below in that publication, the application is not even 
mentioned. It seems that the framework could be used for a nuclear plant, a 
space shuttle, or even a coffee machine. So even if the SIFT framework has 
20 been built to support a flight control system, the designers wished to design a 
framework with "good" safety properties on which they could design their safety 
critical application following fixed replication, communication and voting rules. 

In the document "Extending IEC-61508 Reliability Evaluation techniques 
to Include Common Circuit Designs Used in Industrial Safety Systems", W. M. 
25 Goble et a/., the analysis methods described in the IEC-61508 and 
ANSI/ISA84.01 standards are discussed. The actual effect of particular failures 
are considered' with respect to their effect on the circuit functionality from a 
safety perspective and indicators of that severity are ascribed. Once assigned, 
the severity indicators are fixed. 
30 It can therefore be seen that there is a continuing need for improved 

methods for designing and verifying a safety critical system, which method 
allows the optimization of a hardware architecture in that system. 
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Summary of the Invention 
It is an object of the present invention to provide an improved method 
and technical aids for the design and verification of safety critical systems, and 
5 in particular to provide an improved method of producing a system architecture 
for a plurality of electrical devices connected to each other. 

Accordingly, the present invention provides a method of producing a 
system architecture comprising a plurality of electrical devices connected to 
each other, said system preferably comprising a fault tolerant system, the 
10 method including: 

a) identifying a set of undesirable events and ascribing to each of said 
undesirable events an indicator of their severity; 

b) associating where possible each said undesirable event with one or 
more actuators of said system architecture; 

15 c) developing a functional specification of an initial architecture proposed 

for implementation of said system architecture, said functional 
specification of said initial architecture including dataflow for and 
between components thereof, said components comprising for 
example sensors or actuators, characterized in that the method 

20 includes: 

d) refining on said functional specification the fault tolerance 
requirements associated with the severity of each said undesirable 
event and issuing refined fault tolerance requirements of said 
functional specification; 

25 e) producing replicates in said functional specification together with 

attached indicators of independence of said replicates, said indicators 
reflecting said refined fault tolerance requirements; 
f) defining a hardware structure for said system architecture, e.g. a 
series of electronic control units connected to each other by networks; 

30 g) mapping of said functional specification onto said hardware structure; 

and 

h) verifying automatically that said indicators of independence are 
preserved during mapping. 
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The refinement of the fault tolerance requirements contributes to the 
advantages offered by the present invention and in particular to it being a 
scalable process for the design and verification of a system architecture. 

The method may include, preferably in step (c), defining a series of 
5 modes of operation, e.g. nominal and limp-home modes. 

The method may include specifying said series of modes in the form of 
one or more state charts. 

The method may include mapping geometrically hardware components 
and/or wiring and then verifying automatically that said indicators of 
10 independence are preserved by said geometrical mapping. 

The method may include specifying severity in the form of probability of 
failure per unit of time. The method may include outputting a set of data for 
manufacturing said system architecture. The architecture may comprise an 
architecture for a vehicle, for example a safety critical architecture such as 
15 control circuitry for a brake system. 

The present invention also provides an article of commerce comprising a 
computer readable memory having encoded thereon a program for the design 
and verification of a system architecture, the program including code for 
performing the method of the present invention. 
20 The present invention also provides a computer program product 

comprising a computer readable medium having thereon computer program 
code means, when said program is loaded, to make the computer execute 
procedure to design and verify a system architecture, said procedure 
comprising: 

25 a) identifying a set of undesirable events and ascribing to each of said 

undesirable events an indicator of their severity; 

b) associating where possible each said undesirable event with one or 
more actuators of said system architecture; 

c) developing a functional specification of an initial architecture proposed 
30 for implementation of said system architecture, said functional 

specification of said initial architecture including dataflow for and 
between components thereof, said components comprising for 
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example sensors or actuators, the procedure being characterized in 
that it includes; 

d) refining on said functional specification the fault tolerance 
requirements associated with the severity of each said undesirable 

5 event and issuing refined fault tolerance requirements of said 

functional specification; 

e) producing replicates in said functional specification together with 
attached indicators of independence of said replicates, said indicators 
reflecting said refined fault tolerance requirements; 

10 f) defining a hardware structure for said system architecture, e.g. a 

series of electronic control units connected to each other by networks; 

g) mapping of said functional specification onto said hardware structure; 
and 

h) verifying automatically that said indicators of independence are 
15 preserved during mapping. 

The present invention also provides a design tool adapted for the design 
and verification of a system architecture, said design tool being adapted to 
implement the steps of the method of the present invention, or programmed 
using a computer program product according to the present invention. 

20 

Brief Description of the Drawings 
Figures 1A and IB are schematic and graphical diagrams of the replication of a 
sensor having a certain fault tolerance requirement; 

Figure 2 describes the mapping of a functional architecture onto a hardware 
25 architecture in accordance with a stage in the method of the present invention; 
Figures 3A to 3D describe the tagging stage of he functional architecture and 
the expansion of the tags into replicates and side conditions in accordance with 
the method of the present invention; 

Figures 4A to 4D describe the mapping of fault-tolerance requirements onto a 
30 hardware architecture in accordance with a stage in the method of the present 
invention; 

Figure 5 illustrates the stability of fault-tolerant requirements through functional 
composition in accordance with the method of the present invention; and 
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Figure 6 illustrates the overall process, according to the present invention, of 
design and verification of a fault-tolerant electronic architecture. 

Detailed Description of a Preferred Embodiment 
5 The present invention will now be described by way of example only, with 

reference to certain embodiments and with reference to the above mentioned 
drawings. 

Safety of mechanical components is achieved through the mastering of 
their physical and chemical properties: this is what we call "material resistance", 

10 a well advanced domain of knowledge with a vast experience. Safety of 
electronic components can be achieved through redundancy and voting, 
although a proof of the level of reliability of the result may prove less convenient 
to obtain than may be possible in the world of mechanical components. 

Reference will be made to the term "replicate" and its derivatives. 

15 Replicates in general terms are the implementation in space or time domains of 
redundancy of process dataflow and hardware devices. For instance replicates 
of a sensor may be physical copies of the sensor having the same structure and 
functionality, e.g. another component produced off the same production line; 
Replicates of a dataflow may be another dataflow carrying information which is 

20 the same as the information of the replicated dataflow at a precision and 
sampling rate sufficiently accurate to meet the design tolerances of the system 
in question. Replicate information may be only partial in cases where the only 
purpose of replication is to guarantee that the information is sound. For instance 
a cyclic redundancy check (CRC) may be considered as a partial replicate in 

25 space of the program checked. 

We will distinguish in the present application between functional 
replicates, when the designers provides different mechanism to compute the 
same value, and replicates obtained by copying exact or partial information from 
a unique source. We will consider that functional replicates are dealt with in the 

30 functional architecture before any replicates of same source are performed. Our 
invention deals mainly with replicates from the same source but also takes into 
account requirements coming from functional replicates. 

As replication in time and space is the favored tool in improving reliability 
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of a computation, it is also necessary to gather together the replicated 
information and to decide a correct value among a set of process results, each 
of which may be faulty. This gathering consists all the time in some kind of 
voting, either in space or time. Different algorithms exist for voting and we 
5 assume that a particular algorithm is selected for each kind of vote (between 
two, three or four replicates; and for a fail-silent, or a fault-tolerant computation). 
Note that redundancy may be used under different forms: redundancy in space, 
time and more or less tricky combinations of both. We need redundancy when it 
is not possible to assume that a high level of safety of a particular electronic 

10 component is achievable. We shall now talk about safety of a set of replicates. 

Faults may be symmetric or asymmetric. Asymmetric faults are also 
known referred to as "Byzantine". In the case where different electronic control 
units receive replicates of the same information (whether from different sources 
or not), we call "agreement" the fact that those electronic control units 

15 communicate together to check that they actually got the same information. 
Agreement is also known in the art as "consensus". 

"Byzantine agreement" is specified in the context of communication 
between processes. Imagine process A starts with initial value "1", process B 
starts with initial value "0" and process C starts with initial value "0". The overall 

20 process wants to converge on the same value, so each process transmits its 
initial value to the two others in order to make eventually a majority voting and 
converge to the same value. If A and B are correct, they will transmit 
respectively "1" and "0". Saying that C is Byzantine, means that C may send 
wrong and non symmetric information to A and B. That's the reason why 

25 asymmetric stands for Byzantine. For instance C may transmit "0" to A and "1" 
to B. In that case, A who is working properly, will receive "0" from B and C and 
will conclude "0". B who is working properly will receive "1" from A and B and 
will conclude "1". So as a conclusion, three non faulty processes do not reach 
consensus in one round in presence of one Byzantine failure. However, after a 

30 few rounds, a consensus can be reached if the time constraints allow affording 
these supplementary rounds. 

Typical Byzantine sources of error are current measures in presence of a 
transient short circuit or inductive effect. Depending on exactly when sampling 
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is performed, the actual signal could be high or low by different captures in the 
same period of time. 

Another typical Byzantine source are the clocks in the context of a 
synchronization algorithm. Due to quartz jitters and communication delays, a 
5 clock may send contradictory information to other clocks. 

Byzantine faults (also called asymmetric faults) require a high level of 
redundancy in order to reach consensus in one round. Most of the time 
however, asymmetric faults are not considered in the design because they are 
mostly transient and can be neglect when working on "macroscopic" physical 
10 values. 

Whether we decide to consider asymmetric faults or not, the method of 
the present invention applies equally. Only the number of replicates and the 
redundancy "strategy" differ from symmetric faults. Examples of symmetric 
faults are a communication bus "off 1 , a micro-controller shutdown or crash, a 

15 burned fuse and, perhaps more generally, any "dead" electrical component. 

Electronics safety architectures have been built and tuned for particular 
physical architectures and application domains. As discussed, nuclear plants, 
trains and airplanes are example of costly systems designed by highly skilled 
engineers, which are neither flexible nor sizable. For these systems, a 

20 hierarchical approach has traditionally been used, at the device level first and 
then at the software level. The idea is to identify physical devices with 
objectives and then provide rules to write the software in each node. 

Determinism is a very comfortable property for safety critical systems 
and, as determinism is idealistic, we consider "replica determinism" which 

25 means that the different replicates of a component should always visit the 
"same state" during a period of "real" time. "Real" time here is a theoretical 
notion that "same state" stands for "sufficiently close to be considered equal" as 
we deal with physics and not mathematics. To achieve replica determinism, 
most existing safety systems are time-triggered. The idea of a global clock 

30 allows skipping a complete category of faults: time faults. Having a completely 
synchronous approach allows a "divide and conquer" approach by first living in 
a world where time faults are fixed and then fix precision faults. In fact, 
determinism is a mandatory property of safety critical frameworks because such 
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framework would be nearly impossible to design in the absence of determinism, 

whose design and proof could be too difficult. 

A 1985 paper, "Impossibility of distributed consensus with one faulty 

process" argued that if no assumption is made about the communication rate 
5 between different distributed processes (which means they run on different 

CPUs at different frequencies) then the consensus problem cannot be solved. 

The conclusion of this paper is that some synchronization means are necessary 

when designing a system where exchanges between processes are not 

synchronized: at least an assumption about clock speed is expected. Hopefully, 
10 this is always the case in embedded applications so that it is not, at least 

theoretically, impossible to design asynchronous fault-tolerant systems. 

Confinement is another very important property of safety critical 

frameworks, a general and expensive rule is to avoid mixing systems with 

different fault-tolerance requirements under the assumption that a system which 
15 is not fault-tolerant will be developed with less care and that it is not acceptable . 

that a mistake in the design of an unessential function be the reason of a safety 

system failure. 

Failures are often temporary or even transient. A faulty component may 
be non faulty after a period of time. Hot reset of an electronic control unit (ECU) 

20 is a good example. If for some reason an ECU is not working properly, it is 
generally possible to reset this ECU and make it works properly again even 
while the system is in operation. This means that a failure may be only 
temporary. So failure probabilities are specified per unit of time and this covers 
both definitive failures and temporary failures. 

25 Related to the notion of temporary faults, diagnosis can then be seen as 

a way to reinforce dynamically the reliability of a component or of a system, it 
also allows changing the kind of failure of a component. For instance, an 
electronic control unit can detect that it doesn't work properly or that another 
ECU does not work properly and can then trigger a hot reset. Diagnosis may 

30 allow converting a constant error into a temporary error. For the purpose of our 
application, we will consider diagnosis as a part of the application or as a way to 
meet requirement on the functional architecture. 

Another classical technique of safety critical design systems is the 
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implementation by different sources. Although there are well known examples of 
development of a software containing the same design faults, because the 
development teams had had the same ideas, the technique is recognize as a 
very strong means to avoid design errors. This applies equally to hardware; we 
5 should avoid using the same microprocessor on different nodes of a safety- 
critical system. On one hand, this extends the probability that one of the 
processors will fail, but the probability that two processors fail at the same time 
is far lower. 

We will not address design faults as defined in [Rush95]. An example 
10 based on design faults would be the wrong control law for braking management 
which, under certain circumstances, may lead to no braking at all. Rather, we 
will focus on the question of implementing correctly a sound functional design. 
Implementation of replicates by different sources is an excellent way to cope 
with design faults. 

15 It will be appreciated that in a so-called fail safe system, there exists a 

mode of operation in which the system may loose some or even all of its 
functionality still leaving the user able to operate the equipment or moving the 
equipment into a predetermine condition defined as being safe. For example, 
lorry brakes may be held in the off position by a pressurized air-system. If there 

20 is a failure in the air-system, e.g. broken pipe, the air would escape and the 
brakes would come on, which has been predefined as a safe condition even 
though it doesn't leave the user able to operate the lorry. 

In a fail-operational system, no mode exists in which the system may 
loose some or even all of its functionality still leaving the user able to operate 

25 the equipment or moving the equipment into a predetermine condition defined 
as being safe. In a fail-operational system, a minimum level of service is 
required. 

A fail-silent component is a component that becomes silent in the 
occurrence of a fault in the system in which the fail-silent component is 
30 embedded. This is a qualitative definition. This definition turns out to be 
quantitative if we specify the probability under which the fail-silent component 
should not become silent in case of a failure. For instance we may talk about a 
fail-silent component which may be silent in case of a fault with probability 
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below 10" 9 per hour of operation. A fail-silent component may be fail-silent in the 
occurrence of two faults. When we say simply fail-silent, it is in the occurrence 
of one fault. 

A fault-tolerant component is a component which may achieve a level of 
5 service even in the occurrence of a fault in the system in which the fault-tolerant 
component is embedded. The definition extends to the case where the number 
of faults and the probabilities are specified as in the case of a fail-silent 
component. 

In Safety critical system design, e.g. fail safe or fail operational systems, 

10 we consider mostly fail-silent actuators. This means fault tolerance at the 
system level should be able to take into account at least one or two silent 
actuators. If an actuator cannot be proved fail-silent, we may provide system 
compensation to a failure of such an actuator. For instance, it is possible to 
estimate an abnormal braking force of one of the brakes on a car whose direct 

15 consequence would be a loss of the vehicle stability. This cannot be accepted. 
However, applying an equivalent braking force on the opposite wheel may lead 
to a level of braking different to that requested but substantially equal in 
distribution across and axle, something which is not desirable in itself but which 
is clearly likely to be more acceptable from the safety point of view than uneven 

20 brake force distribution. Such usually temporary modifications to the normal 
function are often referred to as a limp-home mode. Fortunately for many 
electrical components, it's almost always possible to ensure a fail-silent 
behavior. It is sufficient to guarantee that the actuator be passive in case the 
current is cut off. This is typically the solution granted for the ABS control. 

25 In the field of automotive applications, due to large series production, we 

get a quantitative measure of the components reliability which is really excellent 
and sufficient to prove a high level of reliability when using redundancy. 
Unfortunately, another stringent constraint is cost which prevents unnecessary 
redundancy, especially at the hardware level which converts so promptly into 

30 recurring costs. The field of application for safety critical systems like Brake-by- 
wire or Steer-by-wire is particularly adapted to the process of our invention as 
we provide a flexible trade-off between cost and safety and also can base the 
method of the present invention, by which we produce our design, on realistic 
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components reliability which is a definitive advantage over systems designed in 
the avionics or train transportation domains. 

According to the method of the present invention, we do not consider the 
correctness of a piece of code and how faithfully it encodes a mathematical 

5 function. It happens that when dealing with control laws of a safety system, it is 
generally affordable to process software and communications at a pace well 
over the frequency of the physical system controlled so that delay and precision 
of signal processing are not issues. When this is not the case, the optimization 
may be far more difficult but our process remains sound despite the fact that the 

10 safety requirements may seem more difficult to meet. 

In our design process, we do not distinguish between time faults and 
value faults because we consider that both are precision faults. The sensor 
case is especially interesting to discuss redundancy and voting and how time 
faults and value faults may be handled the same way. By way of explanation, 

15 we shall now consider with particular reference for the moment to Figures 1A 
and IB, the case of a sensor S, which has a certain fault-tolerance requirement. 

For some replicate f of some function, such a replicate may have to 
consume a data from sensors S1, S2 and S3 which are replicates of sensor S. 
Suppose that these sensors provide information through respectively dataflow 

20 D1, D2 and D3. For the sake of simplicity and by way of non-limiting example, 
let us consider that S1, S2 and S3 measure a brake pedal position. 

Let us also consider, as a first approximation, that the signal is binary. If 
the signal is high, it means the driver is braking; when the signal is low, the 
driver is not braking. A filtering is performed on the input and the value is 

25 computed from five samples performed every 500 micro seconds. Note that 
filtering is a kind of redundancy as it means we use few samples to build a 
value. This means that when the pedal switch is low, 1.5 ms are necessary 
before the switch detection is really transmitted in the absence of fault. 

Now we must take into account the propagation delay of Dl, D2 and D3 

30 in the architecture. We assume that the capture of sensors S1, S2 and S3 are 
performed on three different microcontrollers with different clocks; clockl, 
clock2, and clock3. So dataflow D1, D2 and D3 in fact go through a complex 
electronic architecture made of electronic control units (ECU's) and 
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communication busses. Let's consider that D1 propagation requires 5ms +/- 
3ms; D2, 8ms +/- 4ms and D3 10ms +/- 2ms, including various clock drifts and 
various jitters. Let's also consider: 

D1 is sent every 5ms = clock1*N1 cycles, D2 every 5ms = clock2*N2 and D3 
5 every 5ms=clock3*N3; 

clockl, clock2 ad clock3 have variations of less that 3%o under normal 
functioning; and 

the task calculating T is executed within 1ms and scheduled every 5ms. 

Suppose we compare the last 3 samples of D1 , D2 and D3 received by f, 
10 let's call them D1f, D2f and D3f. The question is then: when will we converge on 
a pedal braking request identification after an actual pedal braking request by 
the driver? 

D1f represents a signal whose age is in the range R1 [-15,545ms ..- 11,5ms] 
15 1,5ms + 5ms+ (0,003*5ms) + 1ms + 5ms + 3ms = 15,515ms 

D2f represents a signal whose age is in the range R2 [-19,545ms .. -14,5ms] 
1,5ms + 5ms+ (0,003*5ms) + 1ms + 8ms + 4ms = 19,515ms 
D3f represents a signal whose age is in the range R3 [-19,545ms .. - 16,5ms] 
1,5ms + 5ms+ (0,003*5ms) + 1ms + 10ms + 2ms = 19,515ms 

20 

The fact that range R1 and R3 have no intersection is not a problem as 
long as the frequency of the phenomenon we observe is an order of magnitude 
larger than the sampling. If the signal we are looking for is evolving at a 
frequency below or of the order of 20ms, then our sampling is non sense. In 

25 case of a human action, the rate is rather in the range of hundreds of 
milliseconds and, in the case of a brake pedal usually certainly over 100 ms for 
a slight braking, the pedal being pushed during at least one second. 

Turning now to Figure 1B, it can be seen how sampling and 
communications are performed in "real" time. Taking into account the fact that 

30 the value of D1, D2 and D3 is received at most 20 ms after the actual values 
are captured, then any computation of vote between D1 D2 and D3 will yield the 
switch to one except if the number of failures is superior to 1 . 
The same is true if the brake pedal is released. 
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If we take into account the fact that T is scheduled every 5ms (with at 
most 1 ms delay due to its worst case execution time, then T will yield an 
accurate brake command "O" at most 26ms after a brake request has been 
detected. The same is true for a brake release. 
5 Suppose now that we are not dealing with a Boolean signal but rather 

with an integer value representing the pedal brake request. The following 
algorithm may then be used: consider the 3 latest values of D1, D2, D3 are 
received by T and exclude the two extreme values (we consider only one fault). 
We may take care that the different values that we compare were not captured 
10 exactly at the same moment, e.g. the difference of age may be nearly 10 ms. If 
we consider that the pedal brake movement during 10ms is in the range of 
accepted precision, knowing the precision of each sensor, then this algorithm is 
sound. 

It is also possible to filter the value by averaging it with the three previous 
15 values to give some "inertia" in the command if this is acceptable in the context 
of a strong braking. The detail implementation of such filtering, however, is a 
matter of the ergonomics of the pedal and out of the scope of our present 
exposition. 

In a real design, other filters may be introduced that would still increase 
20 the response time in our example. In the case of a braking system, if we 
consider that the output "O" is a command of the brakes that may be performed 
within 24ms by the electromechanical components, it means that braking will 
start at most 50ms after an actual request with a precision that may be specified 
in terms of percentage of the pedal braking request measure. 
25 Our partial brake system is somehow "synchronous": our global time is 

the driver pace of action. What we have shown here is that a distributed system 
doesn't need to be time-triggered to provide dead-line insurance. Also, time 
errors don't need to be considered differently from value precision errors and 
can be turned into a precision range as long as the aging of propagated 
30 information can be bounded with a given precision. The fact that a signal is late 
can then be considered as an error. For instance there is a classical default 
known in the art data buses as the "babbling idiot" default, in which a node of a 
bus is constantly transmitting in an unregulated fashion. This wastes access 
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and traffic time and usually delay messages on the bus. 

The input to our approach according to the present invention is a 
functional design together with functional modes and a functional safety 
analysis. This is obtained by performing the following steps: 
5 a) identifying a set of undesirable events and ascribing to each of those 
undesirable events an indicator of their severity; 

b) associating where possible each of those undesirable events with one or 
more actuators of the system architecture proposed by the functional design; 

c) developing a functional specification of an initial architecture proposed for 
10 implementation of that system architecture, the functional specification of the 

initial architecture including dataflow for and between components thereof, 
those components comprising for example sensors or actuators; and 

d) refining on said functional specification the fault tolerance requirements 
associated with the severity of each said undesirable event and issuing 

15 refined fault tolerance requirements of said functional specification. 

During implementation of the design method, replicates are produced in 
of the functional specification together with attached indicators of independence 
of those replicates, the indicators reflecting the refined fault tolerance 
requirements. The design process also defines a hardware structure for the 

20 proposed system architecture, e.g. a series of electronic control units connected 
to each other by networks and then maps the functional specification onto that 
hardware structure. 

The process includes verifying automatically that those indicators of 
independence are preserved during mapping. Thus, the design process has by 

25 way of an output a proof that the proposed system architecture does or does 
not meet some previously defined safety requirement. If this proof shows that 
the system satisfies the specified safety requirements, it can then be used as an 
input to a validation model for testing. 

A further output of the design process may be a set of local requirements 

30 applying to each component of the architecture that must be proved when 
eventually building the system. This may be in the form of data for use as inputs 
further downstream and may ultimately translate into a set of instructions 
suitable for use in co-operation with a machine producing components or circuit 
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layouts for use in that system architecture. 

Among the advantages of the present invention is the abstraction of 
safety concepts, which allows a divide and conquer approach. This is the key 
for complex systems design. Furthermore, we do not rely on a particular 
5 technology, bus protocol or any predefined safety design framework. On the 
contrary, framework like TTP can be seen as "parameter" in our approach, 
which means we can even produce a fault-tolerant system with no such fault- 
tolerant technology around. Said otherwise, the method we have invented and 
disclosed allows the consideration and comparison of existing frameworks, but 

10 it also provides means to combine them. This former point is especially 
interesting because, as mentioned earlier, combining different technologies is 
the best way to avoid design errors. 

We now consider a specific but non-limiting example relating to vehicle 
braking with reference to vehicle speed detection in figure 2 and its treatment in 

15 abstraction using the methodology illustrated in figures 3A to 5. All the time, an 
overview of the design process can be kept with particular reference to figure 6. 

In figure 2, the function "wheel speed computation" 405 has dataflow "V" 
403 as input from wheel speed sensor 401. In the implementation proposed, the 
same wheel speed sensor 420 is attached to an ECU 436 and the function 

20 "wheel speed computation" 405 is performed on ECU 434. 

Wheel speed sensor 401 from the functional architecture is translated 
(arrow 410) into wheel speed sensor 420 from the hardware architecture. 
Function "wheel speed computation" 405 from the functional architecture is 
translated (arrow 412) into an executable process on ECU 434. Dataflow 

25 between wheel sensor 401 and function "wheel speed computation" is 
translated into a complex path involving: 

• ECUs 436 and 434 and their respective connectors, 428 and 432; 

• network 430; 

• links 422 and 426; and 
30 • connector 424. 

In Figure 3A, function "F" 603 has at least one input dataflow T 601 and 
one output dataflow "o" 605. Other inputs and outputs are not drawn for the 
sake of simplicity. 
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"F" and its input and output can be tagged with fault-tolerance attributes : 

611, 613 and 615. Tag "FT(F) n (613) means that there exist a fault-tolerance 

requirement on function "F". This means intuitively that the implementation of 

"F" will require replicates on different ECUs so that, given a set of input, a 

5 majority of "F" processing will succeed even in the occurrence of one fault. 

"FT(o)" (615) means that there exists a fault tolerance requirement on dataflow 

"o". "FS(i)" (611) means that there exists a fail-silent requirement on dataflow 
HjH 

According to the process described in the invention, tag FT(o) is inferred 
10 from (a consequence of) a safety requirement on a function that consumes 
dataflow "o". In figure 3B, the system designer has deduced from the safety 
requirement on "o" that "F" shall be fault tolerant and that dataflow T shall be 
fail-silent. 

In a further step of the process of the present invention, we can see in 
15 Figure 3C that objects 621 to 655 that safety requirements on function F, 
dataflow "I" and "o" are replicated to cope with the safety requirements specified 
by tags 611, 613 and 615. In Figure 3C, the replicates are defined for one 
symmetric fault. This means only three replicates are required for a fault- 
tolerant component and two replicates for a fail-silent component. 
20 In figure 3C, F1 641, F2 643 and F3 645 are replicates of function "F", 

dataflows FT(o) 1 651, FT(o) 2 653, FT(o) 3 655 are replicates of dataflow "o", 
dataflows FS(i)i 621, 625, 629 and FS(i) 2 623, 627, 631 are replicates of 
dataflow T. 

In Figure 3C, dataflow FT(o)i is processed from F 2 and F 3 results, 
25 respectively "o 2 "(624) and "o 3 "(626) on one hand, and from the processing "01" 
of input FS(i)i and FS(i) 2 by Fi on the other hand. For this processing to be 
performed, a vote procedure may be applied between FS(i)i and FS(i) 2 and 
between computations of "oi" respectively "o 2 n (624) and "o 3 "( 62 6). Under a 
more general embodiment, FT(o)i may be simply the triplet composed of "01" 
30 processed by Fi, "o 2 "(624), "o 3 "(626). In that case, the vote may be performed 
by any function that will consume FT(o)l 

Note that "o 3 "(626) is different from "o 3 "(632) as these dataflow may fail 
differently once implemented because they may not follow the same physical 
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path. So we make the distinction between, "o 3 " processed by F 3 , M o 3 "(626) 
received by Fi and M o 3 "(632) received by F 2 . 

When processing F 1s "o 2 "(624) and n o 3 "(626) need to be computed 
sufficiently recently and there should exist a justification that computations of 
5 "01", ,, o 2 ,, (624) and "o 3 "(626) before a vote are performed in a timely manner as 
described in our brake pedal request example above. Their sampling and aging 
should be sound with respect to ("w.r.t.") the expected precision on dataflow "o". 
Such a justification is simpler in the context of a time-triggered system, which is 
the reason why time-triggered systems are used most of the time when the cost 
10 of electronic components is not an issue (for small series for instance). 

Two replicates of a fail-silent object are said to be free for one symmetric 
fault if a single symmetric fault cannot raise an error on both replicates at a 
time. As a counter example, function "G" in figure 3D shows the case where 
dataflow x1 673 and x2 675 are linked because a fault in the processing of 
15 function "G" raises potentially an error on xl and x2. 

Three replicates of a fault-tolerant object are said to be "free" for one 
symmetric fault if a single symmetric fault cannot raise an error on more that 
one of the replicates at a time. 

For "k" an integer, "2k+1" replicates of a fault-tolerant object are said 
20 "free" for "k" symmetric faults if "k" symmetric faults cannot raise at least an 
error on more that "k" replicates at a time. These definitions can be extended for 
a faii-silent component and for asymmetric faults (e.g. "3k+1"). 

These definitions apply for processes exactly like for dataflow, an error of 
a process is a wrong execution while an error of a flow is a wrong transmission 
25 of information or no transmission at all. The fact that an error can be detected or 
not is something the designers know when tagging the dataflow. 

Associated with the creation of replicates for F and for other objects, 
"freeness" requirements between the replicates of any object are generated. 
This is performed preferably automatically, but ultimately will depend on the 
30 choice of strategy for replication and voting. 

In figure 3C, dataflow FT(o)i 651, FT(o) 2 653 and FT(o) 3 655 shall be 
free, which means a single failure cannot raise an error on more than one of 
these flows at a time. 
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- FS(i)i and FS(i) 2 shall be free, 

- Fi, F 2 , F 3 shall be free, which means that a single fault cannot raise a 
fault in the processing of more that one of the replicates at a time, 

5 - "of dataflow sent to F 2 (622) and to F 3 (628) shall be free, 

- the same requirement is from "o 2 " and "o 3 " instances produced 
respectively by F 2 and F 3 , (624) and (630) on one hand and (632) and 
(626) on the other hand shall be free. 

Other replication schemes can be implemented and their attached 

10 freeness requirements may then differ. For instance, for a system which should 
tolerate an asymmetric fault, four replicates will be necessary for F while only 
three are actually necessary in our Figure 3A to 3D example if only one 
symmetric fault is to be tolerated. 

Freeness is a local property as long as replicates are copies of the same 

15 source. If a fault-tolerant input is based on a vote between three functional 
replicates of a dataflow, say "d, e, f which are different means of computation 
of the same result proposed by the designer, then "d, e, f must be free to 
guarantee that one fault cannot impact two of them, but then the freeness 
property is not local. Saying that three independent dataflows provided by the 

20 designer are "free" means that there is no object which participates at any stage 
in the computation of two of them. This property is a lot more difficult to prove 
because it may involve the whole functional architecture. It may be proved in 
the functional architecture before tagging and replicates and thus forms an 
initial part of the design process embodied in the method of the present 

25 invention. Also, the freeness requirements issued from analysis of the functional 
replicates will have to be met once the functional architecture will be mapped on 
a hardware architecture. 

When we map a functional architecture made of items 621 to 655 onto a 
physical architecture, the freeness requirements shall be satisfied after the 

30 implementation. It means that the components mapped on the hardware 
architecture shall satisfy the same freeness requirements as the components 
before mapping. In figures 4A to 4D, we illustrate the mapping of a fail-silent 
function on a hardware architecture. We start with the same process steps as in 
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figures 3A to 3D. 

In a first step (figure 4A), items 701 to 705, function "J" 703 is specified 
with its input dataflow "k" 701 and an output dataflow T 705. 

In a second step (figure 4B), items 711 to 715, after a backward analysis 
5 from actuators to sensors, function J and its input and output flow are tagged 
with safety attributes, (713) for J, (711) for "k" and (715)for T. TS(J)" 713 
means that J must be fail-silent so that in case a fault occurs, FS(J) either send 
the result of a fault-free processing of J or nothing. 

In a third step (figure 4C), items 721 to 735, replicates and freeness 
10 requirements are specified to provide the required safety level. For instance h 
and i 2 shall be free and functions Ji and J 2 should be free. 

In a fourth step (figure 4D), the redundant functional architecture is 
mapped onto a hardware architecture consisting of ECUs and networks. 
Function Ji is processed on ECU 741 and function J 2 is processed on ECU 743. 
15 We can check that Ji and J 2 are free in this implementation. But if dataflow "h" 
and 'V are mapped on communication bus 745 by the designer, the freeness 
condition of "h" and 'V is not satisfied anymore because one fault (the bus is 
off) will infer an error for both "ii" and "i 2 ". So, it is sounder to have "h" send on 
bus 745 and "i 2 " sent on bus 747 to meet obviously the freeness condition. 
20 Note that, during the mapping of the redundant functional architecture 

onto a hardware architecture, we proceed to a refinement of the safety freeness 
requirements. For instance, the requirement that "ii" and 'V are free turns into 
a requirement that the implementation of these flow are free which is a more 
complex condition. 

25 If we now consider the probability of components to fail, the design of a 

fault tolerant system is more accurate. Freeness conditions are now specified 
in terms of probabilities. 

Let "p" be the largest acceptable probability for a fault to raise a fault of 
both dataflow V and "i 2 " in a period of time. Probability "p" somehow 
30 represents freeness degree of "ii"and "i 2 ". It is also the probability where it is 
acceptable that the system (and function J in particular) be not fail-silent in the 
occurrence of a fault. 

So if flow V and "i 2 " are sent on a bus that failure probability is less than 
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"p". the freeness condition is satisfied. If, on the contrary, assuming "p1" is the 
failure probability of bus 745 and "p2" the failure probability of bus 747, then if 
p1*p2 is superior to "p", then even if "h" is send on bus 745 and"i 2 " on bus 747, 
the freeness requirement is not met and a more reliable design is requested. 
5 In figure 5, we illustrate how tagging and safety requirements are stable 

when combining functions. This aspect is very important because it is the key 
for our "divide and conquer" approach, in which all safety requirements to be 
proven on system will reduce to a proof that a set of processes or of a set of 
dataflow are free. In this manner, the effort to make the proof increases linearly 
10 with the number of functions and dataflow and not exponentially. 

This means that, if we have a safety requirement on the composition of F 
and G (FoG), then this is the result of safety requirements of the flow between F 
and G on one hand, and safety requirements of F and G with other functions on • 
the other hand. Eventually, proving that the system is fault-tolerant will turn out 
15 to be a number of simple proofs at the functional level. Proving that a complex 
system satisfies some safety requirements is equivalent to proving that each 
function in the system meets "local" safety requirements refined from the 
requirements at the system level. For example, proving that 100 sets of 
replicates of functions and/or dataflow mapped on five ECUs are free, may 
20 consist in proving individually that each set of replicates is free. This 
compositional property of safety requirements is the key for a "divide and 
conquer" approach, which as a result is scalable. 

Examples from figures 3A to 3D and 4A to 4D have been appended in 
figure 5. to show how the analysis in figures 3A to 3D and 4A to 4D are 
25 combined when the functions are combined. This gives the flavor of how things 
are dealt with for a complex system involving several functions. 

During composition of functions J and F, dataflow 601 and 705 are 
equalized because they represent the same dataflow "i". If several functions 
consume dataflow T, the safety requirements on T is the maximum of the 
30 safety requirements inherited from each function consuming T. So the number 
of replicates and their reliability is also computed the same way. 

Conversely, if three replicates of a data are available, e.g. because a 
fault-tolerance requirement is specified, this data is consumed by a function 
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having no safety requirement. It is then sufficient to pick up one of the replicates 
output in order to compute that function. On the other hand, if three replicates 
exist, it is because at least one fault-tolerant function replicate will consume all 
three dataflow replicates. 
5 Outline 821 in figure 5 illustrates the composition of functions F and J 

described in figures 3A-D and 4A-D. Note that, as for the T dataflow, dataflow 
725 and one hand and dataflow 621, 625 and 629 on the other hand are 
equalized. Similarly, dataflow 735 on one hand and 623, 627, and 631 on the 
other hand are equalized. 

10 If we consider FoJ, the composition of F and J, then meeting freeness 

requirements for FoJ means meeting freeness requirements between F and J 
inside outline 821 on one hand and for F and for J separately outside 821 . 

So a functional architecture can be recursively tagged completely, 
starting from the actuators and iteratively up to the sensors. Then, functional 

15 replicates together with the freeness requirements can be generated. Note that 
the generation can be performed automatically if the replication strategy is 
standard for each level of fault-tolerance. For instance, every fail-silent function 
in the presence of at most one fault will be replicated the same way as J in 
figure 4. 

20 Once mapping of the redundant functional architecture (after the 

replicates production phase) on a hardware architecture is performed, an 
optimization consists in choosing for any function the dataflow replicates which 
implementation is the less expensive. For instance, if a function F consumes a 
dataflow T with three replicates, i1, i2 and i3. Suppose F does not require any 

25 fault-tolerance property from input T. Then, one of the T replicates needs to be 
consumed. If for instance i1 is available on the ECU which processes F and i2 
is available on another ECU, then it is worth choosing i1 as an input for F. 

In figure 6, a preferred embodiment of the design process of a fault- 
tolerant architecture is described in accordance with the present invention. The 

30 process includes the following steps: 



1 
2 



Identification of undesirable events and their gravity. 

Functional specification of the system built with its real or virtual sensors 

and actuators. 
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3 Description of limp-home modes. 

4 Association of undesirable events with real or virtual actuators. 

5 Refinement of undesirable events on the functional architecture. 

6 Redundancy introduction together with safety requirements refinement. 
5 7 Hardware architecture definition. 

8 Mapping of functions on electronic control units. 

9 Verification of the fault tolerance of the resulting electronic architecture. 

1 0 Geometrical mapping of physical components and wiring. 

11 Verification of the fault tolerance of the resulting electrical-electronic 
10 architecture. 

This process is not intended to be linear. A few loops are hidden in the 
presentation. For instance, step 6 may be implemented through different ways 
which may occasion many reworks. Also, different hardware architectures may 

15 be investigated in step 7, as the goal is to find the less expensive architecture 
under given fault tolerant requirements. In step 8, different mapping will be 
investigated, especially if step 9 proves that a mapping is not satisfactory and 
requires some more work. Also, in step 10, different location of nodes may be 
investigated. The new process steps illustrated in figure 6 will now be described 

20 in greater detail, some aspects of classical techniques not being described in 
full detail herein. 

1. Identification of undesirable events and their gravity 

This step is the well known step of Functional Failure Analysis (FFA) 
25 which is a classical part of safety analysis. The result of FFA for a system is the 
identification of undesirable events together with the severity of the 
consequences when the said events occur. 



2. Functional specification of the system built with its real or virtual 
sensors and actuators 

This step may be performed using for example the technique described 
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above in relation to figure 2. 

At this stage, we can refine the definition of design fault which was 
already mentioned earlier. A design fault is a fault made in the functional 
specification. 

5 

3. Description of limp-home modes: 

Description of modes is complementary to the functional architecture. A 
system can be described as composed of a control-automata, e.g. Statechart, 
that triggers a dataflow [Fuchs98]. At the highest level, the automata should 
10 implement system modes: initialization, nominal mode, limp-home modes and 
the behavior to switch from a mode to another. 

For instance, in the case of a car braking system, if the front left brake is 
not functioning and the other brakes work properly, braking will result in a loss 
of stability of the vehicle which is worse than no braking at all in many cases. 
15 So, in that case, a reliable limp-home mode will consist in braking with front 
right and rear left brakes with adapted braking pressure for each: in that case, 
the vehicle speed will decrease subsequently and the vehicle will remain stable. ; 

In a safety-critical system, limp-home modes will mostly consist in 
providing a degraded service in case the nominal mode is not available due to 
20 some fault. This is the step where we start in Figure 6. 

4. Association of undesirable events with real or virtual actuators and 
state transitions (step a) in Figure 6): 

In our process we consider only a subset of the FFA result, for each 
25 undesirable event, we consider the involved actuators, the actuators of which 
failure will raise the undesirable event, all other actuators functioning normally. 
For instance, for a vehicle braking system, we can consider the undesirable 
event "lack of stability during braking". This may be possible if one of the 
actuators is not braking while the three others are. If our target is that the 
30 system be tolerant to one fault, an analysis may lead for instance to the 
conclusion that the lack of stability is due to a failure of one of the actuators. In 
that case, we would associate "lack of stability during braking" to each of the 
brake actuators alone. If now we consider the undesirable event "no braking 
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while braking requested", then it is clear that none of the actuator received a 
sound command so that this undesirable event is obviously associated with the 
set of all brakes. 

But suppose that our braking system is triggered by a control-automata 
5 and that the braking request is a transition of the automata which leads to state 
"brake". If the transition is not executed properly, the undesirable event will 
occur even if each brake is working properly. So an undesirable event may be 
attached to a state transition if the said state transition failure may raise the said 
undesirable event. At the end of this step each undesirable event is attached to 
10 one or few subsets of all actuators or state transitions results, together with a 
severity. 

A possible reference for the severity levels is provided in norm 
[IEC61508]. Depending on the severity, fail-silent or fault-tolerance levels in the 
presence of one or two faults are expected together with expected probabilities 
15 of failure acceptance. 

In the case of an electrical braking system, the actuators are requested 
to be "fail-silent", i.e., it should be proved that a brake can be put in a physical 
state where it does not function. If a probability is expected, we will say that, the 
electrical brake can be put in a physical state where it does function except with 
20 a probability "p" per unit of time, "p" being very low for instance 1 0" 8 per hour. 

5- Refinement of undesirable events on the functional architecture: 

Given at the beginning of 901 a functional architecture made of sensors, 
actuators and functions and a dataflow, some dataflow modeling an electrical 

25 current, a battery being modeled as a sensor and having identified in previous 
step (a) undesirable events and linked actuators; the design engineer can then 
indicate whether he expects fail-silent or fault-tolerant or no requirement from 
the different input flow of each actuator depending on the undesirable events 
associated with said actuator in isolation. 

30 For instance in the case of a brake system, as a requirement exists that 

a brake alone should not fail, the braking force command of each brake can be 
specified fault-tolerant. But the designer may simply consider that a fail-silent 
requirement is sufficient if the brake system can react sufficiently quickly after a 
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failure is detected. This tagging is depending on the functional architecture and 
its properties, which is an input in our method. 

Iteratively, we then determine the safety requirements of functions and 
sensors by applying the same analysis to each function and each relevant 
5 undesirable event for said function. 

If a function produces a dataflow which, through the functional 
architecture, is contributing directly to the control of a set of actuators, then we 
should consider for that function all the undesired events which are linked to a 
subset of said set of actuators to establish the safety requirements on said 
10 function and on the input of said function. Moreover, we have to consider also 
for that function each constraint on its output is coming from a previous safety 
analysis on a function consuming that output. In Figure 5, for instance, the 
requirement 615 on the output of function F implies requirement 611 on the 
input of function F. This turns out to be also the output of function J so that 
15 previous analysis on function F implies requirement 711 on input of function J 
and a constraint on J itself. 

In step (b), we compute the set of functions for which requirement on the 
output or related undesirable events are not yet processed. 

In step (c), for each function computed in (b), we analyze: 
20 i) which new safety requirements on input are required; and 

ii) what level of safety is required for the function itself (Fault- 
tolerance "FT", Silence in the presence of a fault "FS", Nothing 
"N"), 

We then follow steps 907 and 91 1 and iteratively apply (b) and (c) as 
25 long as the set determined at step (b) is not empty. 

In step (e), each sensor takes the maximum level of fault tolerance 
required for the dataflow it produces. 

Also, the refinement of safety requirements on the dataflow is to be 
performed in each mode because each mode of operation has to be considered 
30 separately. Undesirable events should be applied on mode transitions by 
considering, for each undesirable event, which faulty mode transitions could be 
involved. Note that mode transitions are a particular case of state transition. In 
case a requirement is set on a transition, we proceed exactly like in the case of 
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an actuator. 

It is required that a mode transition does not fail under the undesirable 
event that leads to its activation. So, for each undesirable event that raises a 
mode transition, the mode transition should inherit the safety requirements 
5 corresponding to the undesirable event severity and should be associated with 
that undesirable event. 

6. Redundancy introduction together with safety requirements refinement 
(931 in Figure 6): 

10 Then, in step 931, for each function, an implementation mode of the 

function selected to implement the replicates and voting mechanism is required, 
depending on the safety requirements generated so far. At this step we also 
collect the freeness conditions as described in figures 3A-D, 4A-D and 5. 

The resulting functional architecture is larger than the initial one. Note 

15 that if no Fault-tolerance or Fail-silent requirement is specified, the functional 
architecture is unchanged at this step. 

7. Hardware architecture definition 

At this step, we specify the electronics control units (ECU's) and 
20 networks that will implement the system. In a context where the safety analysis 
is quantitative, expected failure rates per unit of time for each hardware 
component are specified. 

8. Mapping of functions on electronic control units (933): 

25 At this step, the functions are mapped on electronic control units, as 

illustrated in figure 4 for instance. 

9. Verification of the fault tolerance of the resulting electronic architecture 
(935): 

30 This step consists in the verification of the freeness conditions. This 

verification can be performed automatically. For example, the dataflow linked by 
freeness conditions may be recorded in a database accessible to a computer 
being programmed as a design tool. The components implementing a dataflow 
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may also be recorded in such a database in similar fashion. We then find 
automatically using that design tool whether a component implementing several 
free dataflow exists or not. 

The software for implementing the process of the present invention may 
5 usefully be recorded in a computer program product, such as a computer 
readable memory, in the form of a program suitable for execution by a computer 
adapted thereby to operate as that design tool. The computer program product 
may comprise a computer readable medium having encoded on it a computer 
program code in such a form that, when the program is loaded, it makes the 

10 computer execute procedure to design and verify a system architecture in 
accordance with the method of the present invention. 

The output of the request can be the list of such components and that 
output may be in a form suitable for manual or automatic checking of the 
physical design robustness of a proposed architecture. In case probabilities are 

15 specified, the output of the request can be the list of such components with 
reliability below the expected failure probability of freeness conditions. 

10. Geometrical mapping of physical components and wiring (933 bis): 

* At this step the wire paths, connectors and cables between electronic 
20 control units, batteries, sensors, actuators and more generally electrical 
components is specified. 

11. Verification of the fault tolerance of the resulting electrical-electronic 
architecture (935 bis) 

25 The freeness properties are refined through the geometrical mapping of 

components: if two wires W1 and W2 carry respectively dataflow D1 and D2 
and if D1 and D2 are free then, it is not possible to connect wires W1 and W2 to 
the same connector C. If C is faulty, then both W1 and W2 may be 
disconnected due to the same fault which is unsound with respect to the 

30 freeness requirement. 

So the verifications which are to be made after the geometrical mapping 
concern connectors and cables (which gather wires together) and freeness 
conditions are then refined into: 
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- disallow connecting wires carrying free flow to the same connector except if 
probabilities are specified and if the probability for the connector to be faulty is 
below the required freeness default probability. 

- disallow gathering together wires carrying free dataflow in the same cable, 
5 except if the cable production process prevents with sufficiently low probability 

the occurrence of short-cuts, open circuits, i.e. below the default freeness 

probability of the said dataflow. 

Freeness conditions on wired dataflow will produce new requirements 

(impossibility requirements). Verification of this can be performed automatically. 
10 For example, the dataflow linked by freeness conditions may be recorded in a 

database accessible to a computer being programmed as a design tool. The 

components implementing a dataflow may also be recorded in such a database 

in similar fashion. We then find automatically using that design tool whether a 

component implementing several free dataflow exists or not. The software for 
15 implementing the process of the present invention may usefully be recorded in a 

computer readable memory in the form of a computer program for execution by 

a computer adapted thereby to operate as that design tool. 

It can thus be seen that the present invention provides a design process 

having method steps for a scalable design of safety critical systems. 
20 Furthermore, analysis can be performed at the functional level and then used 

on different hardware implementations, e.g. for the purpose of assessing 

whether a proposed hardware implementation is the less expensive and/or 

safer than another. 
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